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Abstract 

Reliable transmission of a discrete memoryless source over a multiple-relay relay-broadcast network 
is considered. Motivated by sensor network applications, it is assumed that the relays and the destinations 
all have access to side information correlated with the underlying source signal. Joint source-channel 
cooperative transmission is studied in which the relays help the transmission of the source signal to the 
destinations by using both their overheard signals, as in the classical channel cooperation scenario, as 
well as the available correlated side information. Decode-and-forward (DF) based cooperative transmis- 
sion is considered in a network of multiple relay terminals and two different achievability schemes are 
proposed: i) a regular encoding and sliding-window decoding scheme without explicit source binning at 
the encoder, and ii) a semi-regular encoding and backward decoding scheme with binning based on the 
side information statistics. It is shown that both of these schemes lead to the same source-channel code 
rate, which is shown to be the source-channel capacity in the case of i) a physically degraded relay 
network in which the side information signals are also degraded in the same order as the channel; and 
ii) a relay-broadcast network in which all the terminals want to reconstruct the source reliably, while 
at most one of them can act as a relay. 
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I. Introduction 

A relay network consists of a source-destination pair and dedicated relay terminals that help 
the transmission of messages from the source to the destination. The classical relay channel 
model [[ll focuses on the maximum channel coding rate that can be achieved with arbitrarily 
small probability of error. Most studies on the relay channel following [1] focus solely on the 
channel coding aspects of relaying, motivated by the improvement in the capacity, reliability or 
coverage extension provided by the relay terminals. On the other hand, in some applications, such 
as sensor networks, the relays might have partial information about the source signal obtained 
through their own sensing capabilities. This additional side information can be used to improve 
the end-to-end system performance. The advantages of exploiting the correlated side information 
in a sensor network from a purely source coding perspective have been illustrated in |[2l. 

Here we consider the transmission of a discrete memoryless (DM) source over a DM relay- 
broadcast network with multiple relays and destinations, in which all the terminals in the network 
have access to their own correlated side information. The relays in the network are dedicated 
terminals whose only goal is to help the transmission of the source signal to the destinations. 
Some of the destinations also have channel inputs through which they can also relay the source 
signal to each other. The goal is the reliable (lossless) transmission of the underlying source 
signal to the destination(s), and the problem is to characterize the maximum number of source 
symbols per channel useLU that can be transmitted reliably, called the source-channel capacity. 
This is a joint source-channel coding generalization of the classical relay network problem. 

In this model the transmission scheme should exploit the availability of the side information 
at the network terminals as well as the overheard channel transmissions. Note that the classical 
channel cooperation ignores the side information at the terminals. However, this can lead to a 
significant performance loss. Consider, for example, a single relay channel in which there is no 
channel from the source terminal to the relay, i.e., the relay channel output is independent of the 
source terminal's channel input, while the relay has access to side information correlated with 
the underlying source signal. In this case the relay can still cooperate with the source terminal 

'Here, the "channel use" refers to the use of the whole network, not the use of the separate source-relay or relay-destination 
channels. A more appropriate term would be the "network use", but we stick here to the more common terminology in the 
literature. 
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by forwarding its side information to the destination. This special case is called the one-helper 
problem, and the benefits of cooperation in this setup are shown in lO and 01. Classical channel 
cooperation schemes cannot exploit the side information at the relay terminal, since their focus 
is on the processing of the overheard signal received by the relay. 

Several channel coding techniques have been proposed for the relay channel [[T]|. In the decode- 
and-forward (DF) protocol the relays decode the underlying message, and cooperate with the 
source terminal to forward it to the destination. While not optimal in general, DF achieves the 
capacity in a physically degraded relay channel [HI. Here, we focus on the DF protocol in the 
joint source-channel transmission setting and propose multiple-relay extensions that exploit the 
side information at the relays and the destinations. 

The DF protocols in the literature are categorized based on the codebook sizes and the decoding 
strategy. In irregular encoding and successive decoding [[T]|, the relay and the source codebooks 
have different sizes and the destination applies successive decoding. In regular encoding and 
sliding-window decoding, introduced in [HI, the source and the relay codebooks have the same 
size and the destination decodes each source message by using two consecutive channel blocks. 
Finally, in regular encoding and backward decoding, introduced in [[6l, the destination waits 
until all channel blocks are received, and decodes the messages starting from the last block and 
going backwards. For single source-single destination relay networks all encoding schemes lead 
to the same set of achievable rates despite having different delay behaviors; however, this is not 
the case in general, and backward decoding might lead to higher rates when there are multiple 
source terminals in the network DF channel coding is extended to multiple-relay networks 
in H, ja, EOl, EB and [fT2l. While [|9l and |fT2l consider irregular encoding, [8] and QOl 
study an extension of the regular encoding and sliding-window decoding scheme, and finally 
ifTTI and lfT3ll extend the backward decoding strategy to multiple relays. 

We propose two different joint source-channel cooperation protocols based on DF relaying. In 
particular we consider the joint source-channel coding extensions of the sliding-window [[8]|, ifTOl 
and backward decoding schemes IfTTI . [[T3l . These two transmission strategies differ in terms 
of the sizes of the codebooks used and the decoding delays, as well as the source encoding 
techniques; hence, these two schemes offer a tradeoff between decoding delay and complexity 
in the system, while achieving the same performance in terms of the source samples that can be 
transmitted per channel use, i.e., the source-channel code rate. 
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In transmitting a source signal to another user with correlated side information, the classical 
random coding approach developed by Slepian and Wolf in [[T4l| is to use binning to reduce 
the amount of transmitted information. Source binning, which will be defined more rigorously 
in Section Unl refers to dividing the possible source sequences into groups and sending only 
the index of the group rather than the index of the sequence. The decoder can then decode the 
source sequence using its side information together with the bin index. In the relay network 
setup with the DF protocol, due to the varying quality of side information at the terminals, 
separate binning is required for each terminal, and the corresponding bin indices are transmitted 
with channel codes at different rates. This will be the approach taken in the construction of the 
backward decoding scheme. However; we will see that transmission at the same rate is also 
possible without resorting to any binning operation. This will be the approach for building the 
sliding-window decoding scheme. 

We should also remark that the proposed protocols are not expected to achieve the optimal 
performance in the general setting since our problem is a generalization of the classical relay 
network problem, which remains open. However, we prove that the proposed DF-based protocols 
achieve the optimal source-channel code rate, i.e., the source-channel capacity, in a physically 
degraded setting in which both the channel outputs and the side information sequences are 
degraded in the same order, and in a relay-broadcast network with one source and multiple 
destinations, such that at most one of the destinations can also act as a relay. 

The problem of joint source-channel cooperative transmission has been previously studied for 
a single relay channel in ifTSl . lfT6l and ifTTl . and for a multiple-relay network in [[T8l and [[T9ll . 
The techniques proposed in all these works are based on DF relaying with different transmission 
techniques. While semi-regular encoding and backward decoding with explicit binning at the 
source encoder is proposed in II15I1 . irregular encoding/ successive decoding with and without 
explicit binning is considered in lfT6l and [fTTl . respectively. In [1181 a regular encoding/ sliding- 
window decoding scheme with explicit binning is considered in the multiple-relay setting. The 
lossy version of joint source-channel cooperative transmission is studied in EOl . 

The rest of the paper is organized as follows: In Section UIl we introduce the system model 
and the problem. In Section [ni] we illustrate the difference between binning and non-binning 
based joint source-channel coding schemes in a point-to-point scenario. The main results of the 
paper are stated in Section |Wl in which the focus is on a relay network with a single destination 
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terminal. In Section |V] we extend the results to relay broadcast networks, and show that the 
proposed achievability technique based on joint source-channel DF scheme is optimal when 
there is only one destination with transmission capability. The paper is concluded in Section IVTl 
The proofs of our main results are detailed in the Appendices. 

In this paper we denote random variables by capital letters, sample values by the respective 
lower case letters, and alphabets by the respective calligraphic letters. The cardinality of set A 
is denoted by |^|. For k < n, the sequence {X^, . . . will be denoted by XJ^, while X^ 
will be used for X". The complement of a certain element Xj in a vector X" will be denoted 

by = (Xi, . . . , Xj_i, Xj+i, . . . , x„). 

Let 7r(-) be an injective functioro from a set {1, . . . , N} to set {1, ... , K} with 1 < X < i^. 
For 1 < i < j < X, we define n(i : j) = {7r(i), 7c{i + 1), . . . , 7r(j)}. We also define, for a set 
C = {ci, . . . ,c„}, neZ+ and q G Z+, Xc = (X,,, . . . ,X,J. 

II. Problem Setup 

We first consider the relay network with a single source-destination pair and multiple relays. 
We have a network of X + 2 terminals (see Fig. [T]): terminal Tq is the source terminal observing 
the source signal So, terminals Tj for i = 1, . . . , X are the K relay terminals each observing 
a different correlated side information signal Si, and terminal Tx+i is the destination terminal 
with its own correlated side information signal Sk+i- The underlying DM relay channel is 
characterized by the conditional distribution 

n 

PiVl, Z/x+lko, , . . . , Xk) = YlpYi,...,YK+i\Xo,...,XK{yi,t, • • • , yK+l,t\xo,t, • • • , XK,t), 

t=l 

where Xi^t G and yi^t G 3^j, respectively, are the channel input and output of terminal Tj at 
time t; and the finite sets Xi and are the corresponding input and output alphabets. We denote 
this channel by (A'o, . . . , XK,p{yi, l/x+iko, a;" , . . . , x^), 3^i, . . . , yx+i)- 

We consider DM independent and identically distributed (i.i.d.) signals (Sq, . . . , Sk+i) which 
are arbitrarily correlated according to a joint distribution p{so, . . . , sk+i) over a finite alphabet 
So X ■ ■ ■ X Sk+1- The sequence {^oj}"^! is denoted as the source sequence while {Sij}'jLi, 
i = 1,...,X + 1, is the side information sequence available at terminal T;. We denote the set 
composed of the source and the side information signals by {Sq, . • . , iSi^+i),p(so, . . . , s^+i)- 

function / on a set A is injective if for all a,b £ A, if /(a) — f{b), then a — b; that is, /(a) = /(&) impUes a = b. 
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Fig. 1. Transmission of a discrete memoryless source over a relay network witii correlated side information. 



Definition 1: An {rn,n) joint source-channel code with the sources (iSq, . . . ^Sk+i) and the 
relay network (A'o, ...,Xk, piVi, • • • , Vk+iI^o^ a;^, . . . , x^), . . . , yx+i) consists of 

1) An encoding function f^""'""^ : S"^ at the source terminal Tq that maps its observation 
Sl^ to a channel codeword of length-n, i.e., Xq — f^'^\S'^). 

2) A series of encoding functions for each relay terminal Tj, i = 1, . . . , f'f^'^^ — {fi^'^\ ■ ■ ■ , /i,^'"^}> 
such that the encoding function at time instant t depends on the previous channel outputs 

y/~^ as well as its side information vector 5™. We have 

^i,t — Ji,t K^iA^ ■ ■ ■ > ^i,t-l, -Jj 

for 1 <i < K andl <t <n. 

3) A decoding function at the destination terminal Tk+i which maps the channel output Y^+i 
and its side information -S'^+i to the estimate by 

The goal of the network is to transmit the source message 5™ to the destination terminal in a 
reliable manner. Reliability is based on the following definition of average probability of error. 
Definition 2: The probability of error for an {m,n) code is defined as 

where the averaging is over both the source and the channel distributions. 
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Fig. 2. Transmission of a discrete memoryless source over a point-to-point ctiannel witli correlated side information. 



Definition 3: We say that the source-channel code rate of r source samples per channel use 
is achievable if there exists a sequence of (m, n) codes satisfying ^ > t whose probability of 
error vanishes with increasing block size, i.e., Pg^™'"-' — > as m, n — )• oo. 

In [|2T| we have defined the source-channel rate as the number of channel uses required to 
transmit each source sample, that is, as the inverse of the source-channel code rate we have 
defined here. The latter definition is in accordance with the definition of the rate of a joint source- 
channel code used in [|22||. Similar to the definition of channel capacity, we define a source- 
channel capacity of a network which considers both the source and the channel characteristics. 

Definition 4: The source-channel capacity of a network is defined as the supremum of all 
achievable source-channel code rates. 

in. Point-to-point Channel: To Bin or Not To Bin 

In this section we focus on the point-to-point channel setup to introduce the basic concepts 
such as binning and source-channel separation, which will be helpful in understanding the coding 
schemes proposed for the relay network. The point-to-point channel without side information at 
the receiver was studied by Shannon, who proved the optimality of source-channel separation 
in this setup [[231. The point-to-point channel with side information at the receiver was studied 
by Shamai and Verdu in ll24l . In the system model introduced in Section [III the point-to-point 
channel with receiver side information corresponds to the case with K = (see Fig. O. It is 
shown in [[24| that a source-channel code rate r is achievable if there exists an input distribution 
p(xo) such that r < and conversely, if the source-channel code rate r is achievable then 

there exists an input distribution p{xq) such that r < ^^j^- Note that /(Xq; Fi) is maximized 
by the capacity achieving input distribution. Hence, equivalently, the source-channel capacity of 
this system is j^^^^g^, where C is the channel capacity. Moreover, it is not very difficult to 
see that the source-channel separation theorem holds for this setup, that is, any source-channel 
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code rate less than the source-channel capacity, can be achieved by first applying source 

coding, and then transmitting the compressed source bits over the channel using a capacity 
achieving channel code. As pointed out in [I24]|, the source encoder in the case of separation is 
a Slepian-Wolf encoder that operates at the conditional entropy rate of H{So\Si) rather than the 
source entropy rate of H(So), due to the availability of the correlated side information at the 
receiver. 

Slepian-Wolf compression involves binning of the source outcomes. The source encoder 
randomly distributes all possible source output sequences S*™ into 2™^*^"^"!"^^) bins, that is, it 
independently assigns an index uniformly distributed over {1, . . . , 2™^(^ol^i)} to each of the 
possible source output sequences. The bin index for each source sequence is transmitted over 
the channel by assigning a channel codeword to each bin index. Having decoded the channel 
codeword, and hence, the bin index, correctly, the receiver outputs the source outcome in the 
corresponding bin that is jointly typical with its side information sequence. 

We next present a coding scheme that generalizes this separate source-channel coding ap- 
proach. In this generalized scheme, we randomly distribute all 5™ sequences into M = 2"^^ 
bins, where R is not necessarily equal to H(So\Si). Let B{i) be the set of sequences allocated to 
bin i. Then, we generate M independent channel codewords of length n according to distribution 
YYtLiPi^o,t), and enumerate these codewords as Xq{w) for w = 1, . . . , M. This constitutes the 
only codebook in the system. Encoding is done as in the separation scheme. The transmitter 
finds the index i of the bin to which sl^^ belongs, and transmits over the channel the codeword 

In the classical source-channel separation approach, the channel decoder, upon observing the 
channel output, decides a single codeword index, and conveys this index to the source decoder. 
This index corresponds to the bin index to which the source sequence belongs. Then the source 
decoder estimates the source sequence using the bin index and the side information sequence. 
For the channel transmission to be successful with high probability, the rate of transmission 
should be less than the channel capacity. Hence, in the separation approach, it is advantageous 
to reduce the number of possible indices to be transmitted through source binning to achieve 
higher source-channel code rates. However, in the generalized scheme, we consider a joint source- 
channel decoder, following the approach in [25 J. The decoder at the receiver looks for an index 
i for which XQ^i) and F" are jointly typical, and at the same time, there exists exactly one 
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source sequence in bin i that is jointly typical with S]^. This source sequence is the output 
of the decoder. Note that, due to the joint nature of decoding using both the side information and 
the channel output, this is not separate source and channel coding in the strict sense. We refer 
the readers to [|25ll and [EH for more discussion on source-channel separation in multi-terminal 
scenarios. 

We have an error if there exists no or more than one such bin index i, or if there exists more 
than one jointly typical sequence within bin i. The probability that there is no bin index satisfying 
the joint typicality condition vanishes as n grows. The probability of having no jointly typical 
source sequence within the correct bin also vanishes since 5™ and S]^ are jointly typical with 
high probability as m grows. The probability of having another jointly typical source sequence 
in the same bin as is bounded by 

in which A'^{So) denotes the set of e-typical n-tuples according to P5,,. Using the classical 
arguments on typical sets [|26ll . it is possible to show that (O goes to zero if i? > H{So\Si). 

We also have an error if there exists another bin index j satisfying the joint typicality 
conditions. The probability of this event can be bounded by 

which goes to zero if ■mH{So\Si) < nI{Xo;Yi). Hence, any rate r satisfying r < is 
achievable. 

Now, we have a set of coding schemes each with a different number of source bins, that is, 
with different R values satisfying R > H(So\Si). As suggested in ll27l . the "joint" decoding 
operation considered in the generalized scheme can equivalently be viewed as a separate source 
and channel decoding scheme, in which the channel decoder is a list decoder, which outputs 
the list of bin indices i for which Xq (i) and are jointly typical. This list decoding approach 
includes separate source-channel coding as a special case with R = H(So\Si); in which case 
we have, with high probability, a single element in the list, i.e., there exists only a single bin 
index whose channel input codeword is typical with the channel output. 

We want to point out here that, on the other extreme, this generalized scheme works without 
any binning, such that we generate an independent channel codeword for each possible source 
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outcome, i.e., R = log |5o|- From a practical point of view, this can be seen as transferring the 
complexity of binning from the encoder to the decoder, which now needs to apply joint decoding 
or list decoding. From a theoretical point of view, since the decoder only outputs typical source 
sequences as its estimate, there is no point in having more than 2™'^^'^'^'')'*"^) bins as, otherwise, 
there would be bins without any typical source sequences, i.e., we have R < H(So). Hence, in 
the rest of the paper, schemes with R = H{So) are considered as no-binning schemes. 

In the case of a point-to-point channel, the only difference between separate source and 
channel coding with binning, and joint decoding with no-binning is the operation at the encoder 
and the decoder. However, as we will see in the following sections, in the case of relay networks 
these two approaches require different transmission protocols, and hence, obtain different delay 
performances even though they still achieve the same source-channel code rate performance. 

IV. Main Results 

In this section we address the main problem of source transmission over relay networks. We 
state our results for the single destination setup in this section while the proofs are given in the 
following sections. The first theorem provides an achievability result. 

Theorem 1: For the DM relay network with correlated relay and destination side information, 
the source-channel code rate r is achievable if, for alH = 1, . . . , A^, 

— 1)) ■^(i)|^7r(i:Af— 1)) 
H{So\S.^(^i)) 

for an satisfying 1 < < K+1, and for some injection 7r(-) from {0, . . . , N} to {0, ... , K + 
1} such that 7r(0) = 0, 7r(A^) = K +1, and for some input distribution p{xo, . . . , xk) and Xk+i 
is a constant. 

Note in ([3]) that we impose decoding constraints for only a subset of the relays in the network 
together with the destination, such that only — 1 relays decode rather than all K of them. 
Excluding some of the relays from cooperation, the relays with a poor channel from the source 
terminal as well as poor side information, can potentially increase the rate in the case of DF 
relaying, as these relays can decode only at very low rates. 

In the appendix we provide two different proofs for the achievability of Theorem [TJ Both 
proofs are based on DF relaying in the joint source-channel setting, that is, the source vector 
5™ is decoded in a lossless fashion by all the terminals participating in cooperation. The first 
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proof is based on block-Markov regular encoding and sliding- window decoding without explicit 
binning. This achievable scheme is based on the joint source-channel decoding scheme with no 
binning introduced in Section Unl Here, we combine this technique with block Markov encoding 
in a multiple-relay setup. The typical source outcomes are mapped directly to different channel 
codewords rather than binning the source outputs prior to channel coding^. The decoders at each 
relay apply joint source-channel decoding (or, separate channel and source decoders in which 
the channel decoder outputs a list of possible inputs rather than a single codeword index). Each 
relay finds the unique index for which the corresponding source codeword is jointly typical 
with its side information while the corresponding channel codewords are jointly typical with 
the received channel vectors in the preceding blocks. This is a regular coding scheme since all 
the terminals in the network use a codebook of the same size, which is equal to the number of 
typical source outputs. The details of this achievability proof are given in Appendix lAl 

The second coding scheme, which was studied in [15] for a single relay channel, uses explicit 
binning at the source encoder and channel codes of different sizes for each terminal in the 
network. We call this scheme semi-regular encoding with backward decoding. The source is 
compressed (by binning) for each separate side information signal in the network, and hence a 
different rate of information is transmitted to each user; however, the rate of the channel codes 
for the terminals that have already decoded the message and are cooperating to forward it to 
the next terminal are the same. This is why we call this coding scheme a semi-regular encoding 
scheme. For decoding we use nested backward decoding ifTTI . [fT3l . The detailed analysis of this 
achievability scheme is given in Appendix |Bl 

These two coding schemes essentially differ in terms of the delay in decoding, while each 
message block is decoded after a delay of K channel blocks in the case of sliding-window 
decoding, the delay is much larger in the case of backward decoding, since the destination can 
start decoding only after receiving all the channel blocks. In the case of pure channel coding, 
the two schemes have exactly the same encoding structure; hence, the tradeoff is between the 
delay and the complexity. However; in the joint source-channel coding setting, there is another 
difference between the proposed coding techniques. While backward decoding works together 

'This is equivalent to binning all source outcomes into 7? = 2™^'*°' bins in the scheme introduced in Section |llll so that 
there is one typical source outcome in each bin. 
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with explicit binning, sliding-window decoding is based on matching the source outcome directly 
to a channel input. Therefore, in practical systems, the backward decoding scheme can be directly 
implemented using the existing point-to-point source codes and DF channel codes for the relay 
channel. However, the sliding-window coding scheme requires building new codes that implement 
the joint source-channel encoding and decoding techniques in practice. 

In the following theorem it is shown that the proposed schemes achieve the source-channel 
capacity in a physically degraded relay network with degraded side information sequences. The 
definition of a physically degraded relay network is given below. 

Definition 5: A discrete memoryless relay network is said to be physically degraded if 

P{yi+U VK+llVh XO:---: Xk) = piVi+l, ■ ■ ■ , VK+iWi, Xi, . . . , Xk) (4) 

for alH = 1, . . . , i^T, or equivalently if 

(Xo, . . . , — >■ (y^, Xi, . . . , Xk) — >■ {Yi+i, . . . , Yk+i) 

forms a Markov chain for all i — 1, . . . , K. 

Theorem 2: For a physically degraded relay network in which the side information sequences 
also form a Markov chain in the same order, i.e., 

5*0 —>■ S*! —>■••• —>■ Sk+1-i 

the source-channel capacity is given by 

. /(X--^;l-|Xf+^) 
sup mm . (5) 

P{xo,Xi,...,Xk) «=l.-,if+l H{SQ\Si) 



Proof: The converse for degraded relay networks follow from the cut-set bound. Consider 
the set Si = {To, . . . and assume that the terminals in Si all have access to the source 

vector 5*™; hence, they can cooperate perfectly for transmitting S*™. We further assume that the 
remaining terminals can also cooperate perfectly by pooling all the available side information 
vectors Sf', . . . , S^+i as well as their received channel outputs Y^, . . . , Y^j^^. This reduces to a 
point-to-point scenario for which the following is a necessary condition for reliable transmission: 

H{So\Si, Sk+i) < rI{Xir'; Y/'+'\X^+'). 
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Fig. 3. Transmission of a discrete memoryless source over a relay-broadcast network with K relay terminals and L destination 
terminals. 



From the degradedness assumption of the side information vectors we have 

H{SQ\Si, . . . , Sk+i) = H{So\Si), 
and from the physically degraded channel assumption we have 

We complete the proof of the theorem by considering all Si sets corresponding to i = 1, . . . ,K + 
1. ■ 

V. Extension to Relay-Broadcast Networks 

It is possible to generalize the achievability results in Section |IV] to a relay -broadcast network, 
in which there are multiple receivers interested in decoding the source samples in a lossless 
fashion (see Figure [3]). In this setting, terminals T^+i, ■ ■ ■ ,Tk+l not only decode the source 
sequence, but can also relay the decoded sequence for each other. We call this more general 
network a relay-broadcast network. The following theorem provides an achievable source-channel 
code rate for a relay-broadcast network. The proof follows similarly to the proof of Theorem 
[H in which a subset of the relays and the destination terminals apply the DF protocol in some 
given order. 

DRAFT 



14 

In this model, the DM channel is characterized by the conditional distribution 

PiVl: • • • ) 1^0 5 ^15 • • • 5 ^1k+l)- 

The source and side information sequences are DM and characterized by the joint distribution 

p(so,...,sx+i) 

over a finite alphabet 5o x ■ ■ ■ x Sk-\-l- Terminal Tq maps its observation to a channel codeword 
of length-n by the encoding function /q'"'"'' : 5™ — )■ Xq. The terminal Tj has encoding functions 

^im,n) ^ ^^(m,n)^ ^ ^(m,„)^ ^^^j^ ^^^^ ^^^^ ^ • • • , F,,.!, Sf), ioV I < ^ < K + L 

and 1 < t < ra. 

The decoder at a destination terminal T^, j = K + 1, . . . ,K + L, maps the channel output YJ" 
and its side information S"' to an estimate 5™^ by the decoding function SJ" = gj^''^\YJ^, SJ"). 
The probability of error is defined as p]"*'"^ = Pr jlJ^lJxVil'S'™ 7^ "S*^}!- The definition of an 
achievable source-channel code rate is similar to Definition |4] using this new probability of error 
definition. 

Theorem 3: For the DM relay-broadcast network with correlated relay and destination side 
information as in Figure [31 the source-channel code rate r is achievable if, for alH = 1, . . . , A^, 

^ ^ -^(^7r(0:t-l); yn{i)\^n{i), ■ ■ ■ , ^njK+L)) 
H{So\STr{i)) 

for an N satisfying L < N < K+L, and for some injection 7r(-) from {0, . . . , A^} to {0, ... , K+ 
L} such that 7r(0) = and {K + 1, K + 2, . . . , K + L} C tt{1 : N), and some input distribution 

p{xo, . . .,xk+l)- 

When all the terminals in the network wish to decode the source sequence, i.e., K = 
in the relay-broadcast network, and the channel inputs of these terminals are deterministic, i.e., 
lA*^.!.!! = . . . = \Xk+l\ = then the problem reduces to the problem of broadcasting a common 
source to multiple terminals each with different side information. This problem is studied in [25 ll 
and it is shown that the source-channel capacity in this setup is given by 

^""P • ^^^1 n(q KV 

p{xo) *=i.---,i' n PolOjj 

For this special case, our achievable scheme based on regular encoding and sliding-window 
decoding reduces to the coding scheme in [|25l . whereas the semi-regular encoding and backward 
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decoding scheme, introduced in the proof of Theorem \T\ provides an alternative optimal coding 
scheme for the broadcasting problem. 

Another special case for which the source-channel capacity can be completely characterized is 
when all the terminals are interested in receiving the source sequence and there is only a single 
terminal with transmission capability, that is, = and \X2\ = ■ ■ ■ = = 1. We have the 
following result for this setup. 

Lemma 1: For the DM single-relay broadcast network with correlated relay and destination 
side information at the terminals, i.e., K = 0, L > 2 and \X2\ = ■ ■ ■ = = 1, the source- 
channel capacity is given by 

cup min[ ^^^°'^^'^^^ I{Xo,X^■,Y2) I{Xo,X,-Yl) \ 

p{xo,xi) 



Proof: While the achievability is a direct result of Theorem [3l the converse follows from 
the cut-set bound. The first term in the minimization comes from the cut around terminal Ti, 
and the following terms follow from the cuts around each of the terminals T2, . . . , T^. ■ 

VI. Conclusion 

We have considered the reliable transmission of a discrete memoryless source signal over 
a cooperative multiple-relay relay-broadcast network in which the relays and the destinations 
all have access to a different side information signal correlated with the source signal. We have 
defined the source-channel code rate of a code for such a system as the number of source symbols 
per channel use that can be transmitted reliably to the destination. The goal is to identify the 
maximum source-channel code rate, which we have defined as the source-channel capacity. 

We have developed two different joint source-channel cooperation schemes which generalize 
decode-and-forward relaying to joint source-channel cooperation in multiple-relay networks, and 
we have identified the achievable source-channel code rate for these schemes. The first scheme 
does not use explicit source binning and is based on regular block-Markov encoding with sliding- 
window joint source-channel decoding, while the second scheme applies explicit source binning 
and uses separate source and channel decoders based on semi-regular block-Markov encoding and 
backward decoding. Our schemes illustrate that these two encoding schemes, apart from leading 
to different amounts of delay in decoding, also require two different types of implementation 
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in the joint source-channel coding context. The consequences of this variation on the design of 
the practical codes is the subject of future research. Moreover, we have proven the optimality 
of DF relaying in the joint source-channel setting for a physically degraded relay channel with 
degraded side information, and for a relay broadcast network when all the terminals are interested 
in decoding the source signal, but at most one of the destinations has the transmission capability. 

Appendix A 

Proof of Theorem [D Regular encoding and sliding- window decoding 

For a given (n, m) pair, we build the code as follows. Consider B — K > source blocks, 
each consisting of m source samples, enumerated as Sl^{b), b = 1, . . . , B — K . These source 
blocks will be transmitted to the destination Tk+i over B channel blocks, each consisting of n 
channel uses. This corresponds to a source-channel code rate of Bn/{B — K)m channel uses 
per source sample. Note that this rate gets arbitrarily close to n/m as 5 — )• oo. 

Without loss of generality, we consider the special injection 7r(i) = i for i = 0, . . . , K + 1, 
and present the achievable scheme for this permutation. Generalization to any other subset of 
the relays and any other decoding order follows similarly. 

Fix p{xo, xk) such that ([3]) holds. We use superposition block Markov encoding and sliding- 
window decoding. 

Source code generation: Generate at random M = 2'"(^('^o)+^) i.i.d. source codewords s"^{wq) 
in S^, Wo G [1,M], each drawn according to the distribution Y[tLiPi^o,t)- This constitutes the 
source codebook. 

Channel code generation: Generate at random M i.i.d. channel codewords x1^_^{wk-i) in 
•^K-i, € [1, M], each drawn according to the distribution YYt=iPi^K~i,t)- This constitutes 

the random channel codebook of relay T^-i- 

Then for each x'^^_^{wk-i), generate at random M conditionally i.i.d. channel codewords 
x^_2{wk-2\wk-i), wk-2 ^ [1, M], cach drawn according to the distribution HtLi p{xK-2,t\^K-i,t{wK 
This constitutes the random channel codebook of relay Tk-2- 

We continue the generation of codebooks sequentially for the terminals Tk-^, Tk-a, ■■■,Tq. 
For each tuple of 

{a;"+i(wi+i|wi+2, . . . ,w7x_i),x"+2(w^i+2|wi+3, • • . . . . ,a;^_i(wx_i)} 
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Fig. 4. Channel codeword assignment for the regular encoding and sliding-window decoding scheme with K = 2 relays. We 
transmit B — 2 source blocks to the destination in B channel blocks. 

generate M conditionally independent channel codewords xf{wi\wi+i, . . . ,wk-i), Wi G [1, M], 
each drawn according to the distribution Y[t=i Pi^iA^i+^A^i+i^ • • • ' "^k-i), ■ ■ ■ , ^K-ii^K-i))- 
This constitutes the random channel codebook of terminal Tj, for i = K — 3, K — A, . . . ,0. 

Finally, the channel codebook generation process is repeated independently K — 1 times, 
and these codebooks are used sequentially over different channel blocks, so that when the joint 
typicality decoding is applied simultaneously over K consecutive channel blocks, the decoding 
errors corresponding to different blocks are independent of each other. 

Encoding: At channel block b, for b = 1, . . . , B — K, the source terminal Tq finds the index 
wo{b) of the source outcome s^{b). The index wo{b) is set to 1 if the source realization is not 
typical. We set wo{b) = 1 for b > B — K for notational convenience. 

From the decoding procedure, which will be presented next, at the beginning of block b for 
b = I, . . . , B, terminal T^, i = 0, . . . , K, has the estimates Wi{b — A; + 1) of Wo{b — A; + 1) for 
k > i + 1, where we let Wo{i) = Wo{i) for z = 1, ... ,6. Terminal Tj then sends xf{wi{b — 
i)\wi{b — i — 1) , . . . , Wi{b — K)) over channel block b using the codebook whose turn has come, 
where we set Wi{b') = Wo{b') = 1 for every b' < 1 and b' > b — K + 1. See Fig. |4] for an 
illustration of the encoding procedure in a network with K = 2 relays. 

Decoding: At the end of block b, for b = 1, . . . , B, terminal Ti, i = 1, . . . , K + 1, declares 
Wi{b — i + 1) = w if there exists a unique index we [1, M] for which 

{s"'{w),Sr{b-z + l))eA:^{So,S,) 

and 

ixt,.,HMb - 0, • • • , Mb -J-K)),... ,xl_,{w,{b - J - K)), Yl'ib - j)) 

G A"(Xj_i_j, . . . , Xk, Yj), 
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in all the blocks b — j for j = 0, . . . ,i — 1. An error is declared if no or more than one such 
index is found. Note that terminal Ti, i — 1, . . . , K + 1, attempts decoding at channel blocks 
i<b<B-K + i-l. 

Analysis of probability of error: The probability of not having a typical source outcome 
vanishes as m increases. Hence, in the rest of the error analysis we will focus on the analysis 
of error for decoding the typical source realization at the nodes. 

Denote by Pi{h) the probability of the event that a decoding error is made at terminal Tj, 
i — 1, . . . ,K m block h, b — 1, . . . , S, conditioned on the event that no decoding error is 
made in the previous blocks. That is, we have 

Pi{b) ^ PT{wiib - i + 1) 7^ wo{b - % + \)\E\b - 1)}, 

where 

E\b) = {wi{}J - i + 1) = wq{}J - i + 1) for all 6' = 1, . . . , 6 and i = 1, . . . , X + 1}. 
Then the probability of error can be bounded as follows 

B 

Pe = P^{"^i(^ - ^ + 1) 7^ wo(6 - i + 1) for some i G {1, . . . , K}\E\b - 1)} • Pr{E\b - 1)}, 

6=1 

(9) 

B K 

^EE^^(^)-M^i^'-i)}- (10) 

6=1 i=l 

Assuming no decoding error is made in the previous blocks, to calculate -Pi(&) we can assume 

Wiilf - i + 1) = wo(6' - i + 1) 

for all 6' = 1, . . . , 6 — 1. Then terminal Tj, % — 1,. . . ,K, declares Wi{b — i + 1) — w, for 
6 — i + 1 > 1, if w is the unique index w e [1,M] such that 

(^'"H, Srib - ^ + 1)) e A^^iSo, Si) (11) 

and 

(xti-j(w\w(b -i),...,w{b-j-K)),..., xl_^{w{b - j - K)),Yr{b - j)) 

eA^{X,_,_,,...,XK,Yi) 

(12) 
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hold simultaneously for all the blocks b ~ j for j = 0,1, . . . ,i — 1. 
We define the following sets 



E^{b) = {we [1, M] : w satisfies (^}, (13) 
Eij{b) = {w e [1, M] : w satisfies (^}, (14) 



i-1 



E,(6)^f|E,,,(6), (15) 

3=0 

for i = 1, . . . , K and 6 = 1, . . . , 5. Then, Pi{b) can be written as 

Pi{b) = Pr {w;o(& - ^ + 1) ^ (&) or u;o(6 - « + 1) ^ Ei{b) 

or for some G £;°(6) n ^^(6) but s™(w') 7^ 5o"(6 - z + - 1)} (16) 



< 



[FT{wo{b + E^{b)} + FT{wo{b - z + 1) ^ E,{b)} 



Fr{E^{b-l)} 

+Pr{ for some w' G E°(6) n E,{b) but s™(w') ^ - i + 1)}] . (17) 
Hence, the probability of error can be bounded as 

B K 

Pe<Y.Yl [P^iMb - ^ + 1) ^ E^{b)} + Pi{wo{b -z + l)^E,{b)} 

6=1 1=1 

+Pr{for some w' G E^{b) f] Ei{b) but s'^iw') ^ s'f^ib - i + 1)}] . (18) 

The first two arguments in the above summation can be made arbitrarily small for large enough 
m and n ll26l . On the other hand, we have 

Pr{for some w' G E^{b) n Ei{b) but s'"(w;') ^ - i + I)} 

< J2 Ft{w' e E^{b)nEi{b)} (19) 

w' e[l,M],w'=iwo(b~i+l) 

Ft{w' e E^{b)} -Fiiw' e Ei{b)} (20) 

w'e[l,M],w'^wo{b-i+l) 

i-1 

FT{w'eE^{b)}-l[FT{w'eE,,{b)}, 

w'e[l,M],w'^wo{b-i+l) j=0 

(21) 

< (M - l^2^"^''^iSo■,S^)-3e)2-niI{Xo,...,X,^l■Y^\X„...,XK-.l)-fi^€) 

(22) 
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where (|20l ) follows from the independence among the source and the channel codebooks; (|2TI) 
follows from the independence among the channel codebooks at consecutive channel blocks; 
and (l22l) follows from the chain rule of mutual information and the following inequality: 

Fi{w' E Ei^jib)} < 2-'^(^(^-i-i;^^l^^-i'-'^if-i)-6^) 

for w' ^ Wo{b — i + 1) . Finally, substituting the value of M, we get 

Prjfor some w' G E^{b) n Ei{b) but ^ s^{b - i + I)} 

^ 2-m[H(So\S^)-bI{Xo,...,X,^i;Y,\X„...,XK-i)-e'] ^23) 

where e' = (4 + 6bi)e. 

For sources and channels satisfying the conditions of the theorem, by appropriately choosing 
e and letting m,n oo, we can have an arbitrarily small probability of error. 

Appendix B 

Proof of Theorem [U Semi-regular encoding and backward decoding 

In backward decoding for the single relay channel [6], while the relay decodes each message 
block right after it is transmitted as in the sliding-window decoding scheme in Section |Al the 
destination waits until all message blocks are transmitted and decodes them in the reverse order 
by removing the interference from the decoded messages. In backward decoding, each message 
is decoded at the destination using the signal received in a single block as opposed to signal 
combining in sliding-window decoding; however, backward decoding introduces additional delay, 
which grows with the number of relays in the network. 

We use the multiple-relay backward decoding scheme for the transmission over the channel 
ifm . [fT3l . This is a nested backward decoding scheme constructed recursively such that, in 
each step of the recursion, a new node decodes the messages up to that point using backward 
decoding. 

Rather than the joint decoding approach in Section |Al in the case of backward decoding we 
use separate source and channel encoders/decoders at each node. In the case of separate source- 
channel coding, the source samples need to be compressed separately for each node such that 
each node receives enough information to decode the source sequence when combined with its 
own side information sequence. For example, in the case of a single relay terminal, the source 
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terminal generates two independent bin indices, one for the relay and one for the destination. 
The transmission of the bin indices require using channel codes at different rates. However, 
note that we need a different rate for each receiving node in the network, and all the terminals 
participating in the transmission of the source terminals to the same node can use the same rate 
for their codes. 

Due to the nested structure of the backward decoding scheme its complexity increases quickly 
with the increasing number of relays. Hence, for simplicity, we present the transmission scheme 
for = 2 relays with a decoding order of Ti,T2,T^. Extension to the setup with more relays 
is a direct generalization. 

As in Section lAl for a given (n, m) pair, we build the code as follows. Fix p{xq, xi, X2) such 
that ^ holds. A total of B'^m source samples will be transmitted over {B + channel uses. 
This corresponds to a source-channel code rate of {B + l)^n/i?^m which gets arbitrarily close 
to n/m as i? — 7- 00. 

Source code generation: Corresponding to each terminal Tj, for i = 1,2,3, we consider 
Mi = 2"^^' bins, called the Tj bins. All possible source outcomes s™ G Tg^ are partitioned 
randomly and uniformly into these bins, independently for each side information sequence, i.e., 
the distribution into Mj bins for Si is independent of the distribution into Mj bins for Sj for 
i ^ j. This bin assignment, which corresponds to source compression, is made available to all 
the terminals. 

Channel code generation: For the channel codebook, generate at random M3 channel code- 
words x^iJs) for G [IjMa] i.i.d. with p (2:2 (js)) = njLip(x2,t), and index them as 2:2(^3) with 

jse [l,M3]. 

Then for each X2(j3), generate at random M2 conditionally independent channel codewords 
Xiihljs), 32 e [1,M2], with probability |x5(j3)) = ^1=iP{.Xi^t\x2,t{.3z)), and index them as 
x?(j2|j3) with J2 G [1,M2]. 

Finally, generate at random the codebook of size Mi for each possible combination of (a^i (j2|j3), (is))' 
with probability p(a;^|a:^(j2|j3), a^aOs)) = n^=iP(xo,t|xi,t(j2, j3), a;2,<(j3)), and index them as 
a;S(ji|j2,j3) with Ji G [l,Mi]. 

Encoding: Consider a source sequence of length B'^m. Partition this sequence into B^ 
portions, s'^^, b = 1, . . . , B"^. Similarly, partition the side information sequences into B"^ length- 
m blocks sf ^™ = [s^^, . . . , s™g2] for i = 1,2, 3. The bin index of the jth block of the source 
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Fig. 5. Channel codeword assignment for the semi-regular encoding and backward decoding scheme with K — 2 relays. We 
transmit source blocks to the destination in {B + 1)^ channel blocks. 



output sequence s^j with respect to Tj bins is denoted by Wj^i. The estimate of Wj^i at node k, 
k = 1, . . . , K + 1, is denoted by Wj ^. See Fig. [5] for an illustration of the encoding scheme. 

In block 1, To observes s™^ and finds the corresponding bin index wi i G [1, Mi]. It transmits 
the channel codeword Xq{wi^i\1,1). The relays Ti and T2 simply transmit and X2{1), 

respectively. In block 2, Tq transmits the channel codeword (w2,i|w^i,2, !)• The relays Ti and 
T2 transmit x^{wl 2\l) and X2 (1), respectively, where lil 2 is the T2 bin index of the estimate s™^ 
at the relay Ti. In the following blocks b = 2, . . . , B, the source terminal transmits the channel 
codeword XQ{wb,i\wb-i,2A) where Wb,i G [l,Mj] for i = 1,2. In block B + 1, Tq transmits 
a;o(l|w2,B, !)• 

The first relay Ti estimates the source block s^^_i at the end of block 6—1, denoted by s^b-i^ 
and finds the corresponding T2 bin index wl_^ 2 ^ [1> ^2]- At block 6, for b = 2, . . . , B + 1, 
Ti transmits the channel codeword ^"(wg b-il^)- '^he first 5 + 1 channel blocks terminal T2 
transmits 0:2 (1). 

At the end of channel block B + 1, the relay T2 decodes the first source block by backward 
decoding. Having estimated the source blocks s^^, . . . , s}^^ by backward decoding, T2 joins the 
transmission for forwarding the T3 bin indices of the first source block to the destination. 

In the following channel blocks Tq superposes the transmission of the second source block 
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to Ti and T2 on the transmission of the T3 bin indices of the first source block to T3. In the 
channel blocks from S + 1 up to 2S + 1, the source terminal transmits, in order. 

The relay Ti transmits, in order, 

3^i(lki,3)>^i(«'B+i,2l«'2,3)> ■ ■ ■ ,3:l(u;2B-l,2kB,3)>^^(«'2B,2|l)■ 
Finally, the second relay T2 transmits (wi^s), ■ ■ ■ , X2{w%^^, ^2 (1)). 

They continue similarly for a total of B channel blocks of Bn channel uses each. In each of 
these B groups of channel blocks Bm source samples are encoded by terminal Tq. In the last 
block of {B + l)n channel uses, no new source samples are encoded. Terminal Tq transmits 

a^O ( 1 1 1 , -U^BCS- 1)+1,3 ) , ■ ■ ■ , ( 1 1 1 , ,3) , ( 1 1 1 , 1) , 

while Ti transmits a:"(l|w^(^_-,^-j_^^ 3)7 • • • > ^1 (1|^b2 3), Xi{l\l), and having estimated the T-^ bin 
indices for the last Bm source samples, T2 transmits a^2 3)) • • • 5 ^2i''^B^ 3); ^2 (!)• It 
can be noted that the last channel block of n channel uses is unused, but is included to simplify 
the expressions as it does not reduce the source-channel code rate in the limit of an infinite 
number of source and channel blocks. 

Decoding and error probability analysis: Since each node tries to decode each block of the 
source sample, we denote the estimate of source block sJJ^^ at note T^., = 1, . . . , + 1, by s™^. 

The relay Ti decodes the source signal by sequentially reconstructing source block at the 
end of the channel block, in which the corresponding Ti bin index is transmitted by the source 
terminal Tq. 

Consider channel block k{B + 1) + 6 for A; = 0, 1, . . . , S — 1 and h— 1,. . .,B. Assume that at 
the end of block k{B-\-l)-\-h—l, Ti has estimated the source blocks s^^, . . . , correctly, 
i.e., s™5 = s™^ for 6 = 1, ... , kB+b—1. Hence, it can correctly find the T2 bin index for 

and the T3 bin index for So"(^_i)^+j,, i.e., wlj^+b~i,2 = WkB+b-1,2 and t')(Vi)i?+6,3 = «^(fc-i)B+fe,3- 
Using this information and its received signal y^{k{B + 1) + h), the Ti channel decoder attempts 
to decode tyfeB+6,i, i.e., the Ti bin index corresponding to s^J^^s+b, by looking for a unique index 
w such that 

{x''^{w\WkB+b-l,2, W(k-l)B+b,z),x'^{wlB+b-l,2\w\k-l)B+b,i).x'i{^^^^ Y^{b)) G Xg, X3, Fi), 
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where tt)^ 3 = Wb,3 = 1 for i = 1, 2, if 6 < 1. If such a unique index is found, then it is assigned 
as the bin index estimation of the source sequence at node Ti, wl^. 

The estimated bin index is then given to the Ti source decoder. With the Ti bin index and 
the side information s^i^^_^_^, the Ti source decoder estimates s™^^.,,^ by looking for a unique 
source codeword which is jointly typical with S'^{kB + b) and whose bin index is ^^^+6,1- If 
such a unique codeword is found, it is assigned as the source estimation at Ti, denoted by s^^. 

At the end of channel block k{B + 1) + S + 1, for A; = 0, . . . , S - 1, the relay T2 decodes the 
T2 bin index for the source block s^\^^^. It then continues decoding in the reverse order by 
backward decoding. Assuming that it has estimated the source blocks sJJ^j^, . . . , So\k-i)B+B 
^o^kB+b+n • • • ' ^o^kB+B correctly, it can find the Ti bin index of Sq"^^_|_(,^^ and the T3 bin index 
of ^o^(k-i)B+b- Using this information and its received signal Y2{k{B + 1) + 6), the T2 channel 
decoder attempts to decode WkB+b,2 by looking for a unique index w such that 

{xl{WkB+b+lAw,W(^k_l)B+b,i),x'^{w\wl,^_^^B^^^^),X^^^ + 1) + 6)) 

e>i:(Xi,X2,X3,y2). 

If such a unique index is found, then it is assigned as the bin index estimation of the source 
sequence s^{kB + h) at node T2, WkB+bfl- 

The estimated bin index is then given to the T2 source decoder. With the T2 bin index and the 
side information s^^B+b, the T2 source decoder estimates sJJ^j.^^^ by looking for a unique source 
codeword which is jointly typical with S^{kB + b) and whose bin index is ^t'|B+^,2• If such a 
unique codeword is found, it is assigned as the source estimation at Ti, denoted by s^'^B+b- 

Decoding at the destination node T3 is also done using backward decoding, but the destination 
waits till the end of channel block B{B + 1) + B. It first tries to decode the T3 bin index of 
the last source block using the received signal at channel block B{B + 1) + B. Consider 
decoding of - 1)B + b) at channel block k{B + 1) + b for k ^ 1, B aad b ^ 1, B. 
Assuming that it has decoded the source blocks . . . ,s^^2 correctly, it can find 

the Ti bin index of s'o[kB+b the T2 bin index of s'lf^'kB+b-i- Using these information and its 
received signal Y^{k{B + 1) + h), the T3 channel decoder attempts to decode W(fc_i)B+b,3 by 
looking for a unique index w such that 
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If such a unique index is found, then it is assigned as the bin index estimation of the source 
sequence s^{{k — 1)B + h) at node T2, WkB+b,2- 

The estimated bin index is then given to the source decoder. With the bin index and 
the side information -s^^^^^^^j,, the T3 source decoder estimates by looking for a 

unique source codeword that is jointly typical with S^{{k — 1)B + h) and whose bin index is 

^ 3 

'"^(fe-l)S+b,3- 

We upper bound the probability of error by counting errors made not only at the destination, 
but at any terminal in the network. 



Sfl2m I b=l,...,B2 k=l,...,K + l 



> Pr l^-^''" = s^'"*! .(24) 



We can write the above union in a recursive manner by considering the decoding order of 
the backward decoding scheme; that is, the above event of having an error in estimating any 
of the source blocks at any of the nodes can be written as the union of error events, such 
that each corresponds to an error event at one stage of decoding given that no error has been 
made previously. Note that the decoding order is as follows: s™j^, s™2' • • • > ^T,b^ ^2',bi ■ ■ ■ ■> ^^i^ 

sm 5m 5m 5m 5m sm im 5m sm sm 

■ ■ ■ 1 *1,2B' *2,2B' ■ ■ ■ 1 *2,B+H ■ ■ ■' *1,(B-1)B+1' ■ • • ' *1,B2, *2,B2) ■ ■ ■ i *2,(B-1)B+1' *3,B2 ' *3,B2-1' 

We have 

gB^m. \^b=l,...,B^ k=l,...,K+l 

■Fr{Eb,k\S''""' = s^'™}} Pr j^^'™ = s^''"} , (25) 

where we define E^^k as the event that all previous estimations are correct when Tk estimates 
S^^. Then we get 

< 5^ fe$^Pr{5^rfc7^4y^.,/c,^^'"^ = «^'n|-^r{'5^'"^ (26) 

gB^m K b k ) 

gB'^m \ b k 

+Pr{^,-, ^ , + Mb, k)\E,,,, 5^'- = .^'-}} • Pr {^^'^ = s^'^] , (27) 
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gB^m Kb k 

+Pr{wf^ ^ w{h, k)\Eb,k, S^'"" = s^''"}} ■ Pr js^''" = s^''"} , (28) 
= E E P^i^Cfc 7^ ^^^.K^ = ^(b, k), E,,,} 

+ E |EEp^{<'^ ^ = s^'^}\ Pr {S^'"^ = s^'"^] , (29) 

+ E E E P^^^ffc ^ ^>^'^ = = w{b, AC3JQ) 

b fc «)(f),fc)e{i,...,2'"-"fc} 

= E E p^{^r^ ^ ^o":6K. = Hb, k), e,,,} 

b k 

+EE^ E PT{Kk^w{b,k)\E,,,,w,,k = w{b,k)}. (31) 

b k «)(6,fc)e{l,...,2'"-«fc} 

Now, note in (|3TI) that each term in the first summation corresponds to the error event at the 
source decoder of given that it is provided with the correct bin index, and each term in the 
second summation corresponds to the error event at the channel decoder of T^, both conditioned 
on the fact that all the estimations up to that instant are correct. Following the usual arguments, 
we get 

Pe i{b) < E E {s""^"' ■ 2"'^^^'^°l'^''-^+'^ + 2""^" ■ 2-"(^(^o"';'^fcl^f +')+^)| (32) 

b k 

Setting Rk = H{So\Sk), and letting m, n — )■ 00 while e — )► 0, the error probability vanishes 
under the assumptions of the theorem. 
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